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Introduction 



The School Dislr»a of the Citv of Saginaw's Adult Basic Education (ABF) program is designed to provide 
educational service^i to adult who have l^ss than an eighth grade education. These services included basic and 
remedial instruction in communication and computation skills, Michigan life role competencies (Ml.RC), English as 
a second language (FSL). adult bilingual. ’ pre-general educational development (Pre-GED). fhe 1994 95 
school year is the program's thirty-fourth consecutive year of operation. 

The ABF program serves a diverse population of adults with program goals and objectives designed to meet 
their educational needs. Among these adult learners are the following: those residing in urban, high unemployment 
areas: members of minority groups; those residing in rural areas; limited English speaking, elderly; handicapped; 
immigrant; institutionalized; and women with special needs. During 1994 95, 1097 adult learners from these groups 
received serv ices. Demographic data (racial ethnic, gender, and age)' can be found in Appendix A. 

Enrollment in ABF. is open throughout the vear. Upon enrolling, each student's needs are identified. An 
individualized educational plan (lEP), which focuses on those needs and establishes educational objectives for that 
student, is drawn up. The teacher to whom that student is assigned writes that plan with the student. 

Students anended one or more of the 2 ?> classes conducted at the four centers located throughout Saginaw. 
The sites are listed in Appendix B . Each class at Ruben Daniels Lifelong Learning Center (RDl.LC; the program's 
home site) was three hours in length. The first ninet> minutes were spent with one teacher working on assignments 
in either; a) reading language arts, or b) mathematics and Ml.RC. The students rotated to another teacher for the 
remaining ninety minutes and worked on assignments on that lopic(s) which had not been studied in the first ninety 
minutes. The assignments, within topic, vary by students' objectives, needs, and ability level. 

The ABE staff initially consisted of 27 paid people. It included one program supervisor, sixteen teachers, 
(equaled 14.5 full-time equivalent teachers)' , six teacher aides, one student-advisor, one learning lab instructor, one 
full-time and one part-time secretary . In addition, there were 18 volunteer literacy tutors. 



‘ For 1096 students; one instructor failed to provide any demographic data for one student. 
* Mid-year financial cutbacks necessitated staff reductions to 14 ( 12.0 FTP) teachers. 






A process evaluation consisting of classroom observations was conducted to determine the status of program 
operations. This description of the program status will be the focus of the first part of this report, 

A product evaluation was conducted to determine program performance relative to the goals and objectives 
of the grant. This product evaluation w ill be the focus of the second part of this report. 



Method 



This section describes the procedure^ u!>ed in the process and product evaluations. 

Process 

The purpose of a process evaluation is to determine whether a program is being implemented as planned 
and or if there are any problems in its operation. This year, as in previous years, the process evaluation consisted of 
on-site classroom observaticriis. 

Beginning April 11. 1995 and continuing through May 2, 1995, two evaluators conducted on-site 
observations of ABR classrooms.' Rach observation lasted the entire length of the class session. 

The instrument used to record these observations (see Appendix C) is the same instrument used in previous 
\ears' process evaluations. The instrument, and the observations, focused upon the following ten aspects of an ABR 
classroom: the start of the class: the time spent on each subject area (reading, mathematics, and MLRC) , <id total; 
the modes of instruction: the extent of individualized instruction; the types of materials used: the frequency and 
nature of feedback: the frequency of and reaction to disruptive behavior: the degree of formality in the classroom; 
lesson congruity: and testing occurrence and procedures. 

It should be noted that, prior to the start of these observations, the ABE instructors were informed, by the 
program supervisor, that the observations would be beginning and that their intent was to evaluate the program as a 
whole and not individual instructors. 

Ihe process data presented in the results section were taken directlv from the completed observation 
instruments. 



Product 

The purpose of a product evaluation is to determine whether a program attained the goals and objectives 
stated in its grant. As in previous years, records submitted to the Rvaluation Depailment by the program supervisor 
provided the data to make this determination. 



' f ourteen sites were observed: two sites were closed prior to the observations. 



Data describing student performance on individually assigned objectives were recorded by the teachers on 
the Adult Basic Education Objective Reporting Form (see Appendix D). Teachers also entered deniograpinc 
information on these forms. During staff inservices, the supervisor and an evaluator stressed to the staff the 



importance of full, accurate, and timely completion of these sheets. 

Additional student performance data, submined to the Evaluation Department by the program supervisor, 
were the number of adult learners who: 1) completed the program (tested above the eighth grade level on the 

TABE^ or passed the General Educational Development Test [GED]; or 2) moved up from one program level to 
another (process described in the results section, below). 

Dropout data were obtained from the siimmar>' fomis submined by the supervisor to the State Department of 
Education. 

Submitted data were compared to the standard mandated in the gram. 

In the next section, evaluation results are presented. 



^ Tests of Adult Basic Flducation , published by CTB 'McGraw-Hill Company in 1987. 
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Results 



The results are presented in two parts: process and product. 

Process 

The following are the findings from the on-site observations of 14 ABE classrooms. These findings are 
summarized under headings corresponding to the nine aspects of ABE classrooms addressed by the observation 
instrument. The entire tabulated results of the 1994/95 observations can be found in Appendix C. 

Start of Each Class 

There were four class start-up concerns; was each class started on time; was the classroom teacher present at 
least five minutes prior to the class starting; was attendance taken via a sign-in sheet: and was a preview of class 
activities presented? Table I. below, presents the findings as to these elements. 

Table I 

Class Start Elements 



Elements 


n 


Occurred? 

Yes No 

% n % 


Total 

n % 


Class began on time 


14 


100.0 


0 


0.0 


14 


100.0 


Teacher was present 


13 


92.9 


1 


7.1 


14 


100.0 


at least five minutes 














before class began 














Attendance was taken 


14 


100.0 


0 


0.0 


14 


100.0 


via sign-in sheet 














A preview was given 


13 


92.9 


1 


7.1 


14 


100.0 



Note. N 14 classrooms. 




5 




A review of Table 1 reveals the following points: 



• In 13 (92.9%) of the observed sites, the teacher was present before it started, 
and a general preview of class activities was offered. 

• In all 14 (100.0%) of the observed sites, classes began on time and attendance 
W'as taken via sign-in sheets. 



Time Spent in Instruction 

‘fhree areas which were to be taught on a daily basis in the ABE classes: reading, mathematics, and MLRC. 
Table 2. below , presents the number and percent of sites observed offering instruction, by topic. 

Table 2 

Instruction Offered 



Instruction Offered? 



Topic 


n 


Yes 

% 


n 


No 

% 


n 


Total 

% 


Reading 


14 


100.0 


0 


0.0 


14 


100.0 


Mathematics 


14 


100.0 


0 


0.0 


14 


100.0 


MLRC 


12 


85.7 


2 


14.3 


14 


100.0 



Note. N 14 classrooms. 

An examination of Table 2 indicates that reading and mathematics v/ere offered in all the sessions. MLR(' 
instruction was observed in 85.7% of the sessions. 

Across classrooms, the supervisor’s intention was that the time devoted to each of these topics was 
to be approximately equal (excepting the ESL and bilingual classes, where the focus was on English use) with 
reading instruction allotted the most class time, mathematics the second most, and MLRC the respective least. 
Table 3 below, presents the mean instructional time allotted each topic in all ABE classrooms. (Appendix C 
contains these data for standard^ ABE classrooms.) 



Standard ABE classrooms were those designed to offer reading, mathematics, and MLRC instruction in a 
three-hour block. Instructional time for all classes excluding those where the focus is more directed on one of these 
topics (i.e., ESL or bilingual) or where the class length is different (i.e., pregnant teen) is presented in footnotes to 
C ll-l,andC IV-1). 
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Prior to examining Table 3, it should be noted that, per the supervisor’s request, time spent viewing Channel 



One was excluded from instructional lime. 



Table 3 

Amount of Instruction 





Instructional Time 


Topic 




In Minutes 




M 


SD 


Reading/Language Arts 


90.9 


17.4 


Mathematics 


48.7 


13.2 


MLRC 


22.7 


14.4 



Note. Average scheduled class time was 1 80.0 minutes (see text below). 
Reading instruction and mathematics instruciion N = 14, and MLRC 
instruction N - 12 classrooms. Readers are reminded these statistics 
were calculated using all observed classes, some of which did not have 
instruction in all topics. 



From Table 3, it can be seen that reading instruction accounted for the most minutes, mathematics the second 
most, and MLRC the least. (This relative emphasis was also found across the standard ABE classes, although the 
average time spend per topic [except MLRC] and the variance between teachers was less, see Appendix C.) 

In interpreting Tables 2 and 3 (and C-1), it is important to recall from above the intention of the program 
supervisor. 

The evidence from the tables suggests that this intention is not fully realized . 

• While reading and mathematics instruction occurred in all of the sessions, 

MLRC instruction did not. 

• WTile the amount of time devoted to instruction per topic is consistent with 
the supervisor's intentions, the standard deviations indicate that there is still a 
variance between instructors in the amount per topic instruction offered. 

(An examination of data in Appendix C IMV suggests that variance is not 
solely due to differences in the nature of the classes.)^ 



i.e., ESL versus standard ABE classes. 
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The final aspect of interest in this regard was the total amount of instructional lime. From Appendix C 
(XM). one can learn the mean scheduled instruction time was 180.0 minutes (SD = 2!.0) and the mean actual time 



was 167.3 (SD =- 24.7). The mean difference between scheduled and actual time was -12.7 minutes (SD 8.6). 
Serial Order of Topics 

An examination of Appendix C. XI-2, reveals the follow ing. 



• Reading language arts was presented first in five (35,7%) cases, and third in 
nine (64.3%) cases. 

• Mathematics instruction occurred first in three (21.4%) sites, second in ten 
(71.4%) sites, and third in one (7.1%) site. 

• MLRC was the first topic in six (42.9%) sites, the second topic in four 
(28.6%), third and fourth in one ( /.1%) each, and not seen in two (14.3%). 



The Modes of Instruction 

There were ten modes of instruction specified on the observation instrument; modeling, guided practice 
(monitoring), checking for understanding, drill, lecture, problem solving, group discussion, review /follow-up, 
reading aloud (by student, teacher, or choral) and, exercises on the chalkboard. In Table 4, below, presents the ABE 
instructors' of the use of these and other observed methods, by topic (see also. Appendix C II-3 III-3, and IV-3). 
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Table 4 



Instructional Modes by Topic 











Topic 






Modes of Instruction 


Reading 


Msthematics 


MLRC 




(n= 






(n=l4) 


(n= 


12) 




n 




n 


% 


n 


% 


Modeling 


> 


21.4 


2 


14.3 


0 


0.0 


Guided practice^ monitoring) 


13 


92.9 


1 1 


78.6 


4 


33.3 


Checking for understanding 


13 


92.9 


12 


88.7 


9 


75.0 


Drill 


2 


14.3 


1 


7.1 


1 


8.3 


Lecture 


2 


14.3 


3 


21.4 


2 


16.7 


Problem solving 


1 


7.1 


3 


21.4 


1 


8.3 


Group discussion 


5 


35.7 


5 


35.7 


8 


66.7 


Review/follow-up 


9 


64.3 


6 


42.9 


6 


50.0 


Reading aloud (student) 


7 


50.0 


I 


7.1 


6 


50.0 


Reading aloud (teacher) 


7 


50.0 


0 


0.0 


6 


50.0 


Reading aloud (choral) 


0 


0.0 


0 


0.0 


1 


8.3 


Question and answer 


2 


14.3 


0 


0.0 


1 


8.3 


Chalkboard exercises 


4 


28.6 


5 


35.7 


0 


0.0 


Kumon (see Appendix G) 


N/A 


“ 


1 


7.1 


N/A 


“ 



Note. N = 14 classrooms. 

^Number of sites in which instruction in the relevant topic occurred. 
^Percents sum to more than 100: instructors used multiple methods. 



A review of Table 4 suggests the following. 



• Instructors arc using multiple modes of instruction. 

• For reading instruction, guided practice and checking for understanding were 
used in most classes. Review/follow-up, and reading aloud by the student and 
teacher were used in over half of the classrooms. 

• In mathematics instruction, checking for understanding, and guided practice 
were the most frequently used modes. Review/follow-up, group discussion, 
and chalkboard exercises were seen often. Other modes were used 
infrequently (in less than 25% of the sites), if at all. 

• Checking for understanding (75.0%) and group discussion (66.7%) were the 
preferred modes of MLRC instruction. Review/follow-up and teachers and 
students ‘^eading aloud were also seen in at least half of the sites. 
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Related to the modes of instruction was whether the instructor offered previews, checked for students' 
understanding, specified the objective, and offered a closure on lessons. Table 5, below, shows the occurrence of 
these variables in ABE! classrooms, by instructional site. 



Table 5 

Instructional Variables by Topic 



Instructional Variables 



Teacher 



Topic 



Preview 



Checking Specified 

Understanding Objective Closure 





n 


% 


n 


% 


n 


% 


n 


% 


Reading (N= 14)3 


9 


64.3 


9 


64.3 


8 


57.1 


2 


14.3 


Matliematics (N^ 14)*^ 


1 1 


78.6 


1 1 


78.6 


10 


71.4 


4 


28.6 


MLRC (N=12) 


1 1 


91.7 


10 


83.3 


7 


58.3 


7 


58.3 



Note. N 14 reading and math classrooms. N - 12 MLRC classrooms. 

^Number of sites in which instruction in the specified topic occurred. 

^One (7.1%) of the 14 sites where mathematics instruction was observed used the Kumon 
method, which does not employ these variables (see Appendix G). 



By examining Tabic 5. one can find that the frequency of instructional variables changed by subject area. 



• In reading/language arts, previews, and checking for understanding occurred 
in under two thirds of the sites; while specifying objectives occurred in 
approximately half, and closure occurred in 14.3% of the sites. 

• In mathematics, previews, checking for understanding, and teachers specifying 
objectives occurred at over 70% of the sites, but closure occurred at 28.6% of 
them. 

• In MLRC, checking for understanding and offering previews occurred in over 
80% of the sites (which offered MLRC); and specified objectives and closure 
were observed in over half of those sites. 
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Individualized Instruction 



The extent to which instruction was individualized was also examined. Table 6, below, presents the number 
and percent of observed sites where individualized instruction occurred, either one a one-to-one or a small group 
basis, by instructional topic. 

Table 6 

Individualized Instruction by Topic 




Individualized Instruction 



Whole 



Topic 


One-on-One 


Small Group 


Both 


Class^ 


Kumon* *^ 


n 


% 


n 


% 


n % 


n 


% 


n % 


Reading (N=14)C-d 


8 


57.1 


1 


7.1 


3 21.4 


2 


14.3 


_ 


Mathematics (N= 14)^ 


8 


57.1 


2 


14.3 


1 7.1 


2 


14.3 


1 7.1 


MLRC (N-12) 


2 


16.7 


1 


8.3 


1 8.3 


8 


66.7 


- 



Note. N = 14 reading and math classrooms. N = 12 MLRC classrooms. 

^Instruction was addressed to all students simultaneously. 

^See Appendix G. 

^Number of sites in w hich instruction in the topic occurred. 

^Sums across to 99.9% due to rounding. 



From examining Table 6, the following can be seen about individualized instruction. 



• In reading instruction, it occurred in all 14 of the sessions. In most (8; 57.1%) 
cases, the one-to-one form was used. 

• In mathematics instruction, it occurred in 13 (92.9%) sessions and it was most 
frequently on a one-to-one basis (8 sites; 57.1%); the remaining site (7.1%) 
used the Kunion method of mathematics instruction, which precludes 
individualized instruction. 

• In MLRC instruction, it occurred in 4 of 12 (33.3%) sessions and was most 
frequently on a one-to-one basis (2 sites; 16.7%). 
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Types of Materials 



Another element of interest was whether the textbooks and/or workbooks used were on the ABE book list. 
Table 7, below, shows the number and percent of classrooms using materials from the book list during instruction, 
by topic. 

Table 7 

Classroom Use of Books on Book List 



On ABE Book List? 



Topic 



Reading (N^I4)^ 
Mathematics (N^ 14) 
MLRC(N-12) 



Yes 

n % 



12 85.7 

10 71.4 

11 91.7 



No 

n % 



2 14.3 

4 28.6 

I 8.3 



Note. N ^ 14 reading and math classrooms. N ^ 1 2 MLRC classrooms. 
^Number of sties in w hich instruction in the topic occurred. 



From viewing Table 7. it can be seen that the majority (71.4% - 91.7°/o) of observed ABE classrooms used 
books or materials on the ABE book list. 
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Other instructional materials used included the following, by subject area (frequency of sites in parentheses). 



• Reading Language Arts: 

♦ Handouts (4) 

♦ Journal (4) 

♦ Computer assisted instruction (2) 

♦ Films on videotape (2) 

♦ Audio tape ( 1 ) 

♦Card reader (I) 

• Mathematics: 

♦ Handouts (7) 

♦ Flashcards (1) 

♦ Computer assisted instruction ( 1 ) 

♦ Notebooks ( I ) 



• MLRC: 



♦ Handouts ( 1 ) 

♦ Map ( I ) 

♦ Globed) 

♦ Wall chart ( 1 ) 



Frequency and Nature of Feedback 

Providing students w ith effective and appropriate feedback is an important element of ABE classes. Within 
each observation, during a specified period of time (lasting ten minutes), the frequency of positive and negative 
feedback was recorded (Appendix C, V-4). Also recorded was the evaluator's assessment of whether the feedback 
was effective and appropriate. 

Positive comments were observed in all 14 (100.0%) sites, with a mean frequency of 5.9 (SD = 2.4). 
Negative comments were observed in two sites (14.3%) with a mean frequency of 1.5 (SD = 0.5). In all cases, 
feedback was found to be both appropriate and effective, as negative feedback was followed by examples of 
positive behavior. 
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Frequency of and Reaction to Disruptive Behavior 



A question related to feedback was whether any disruptive behavior occurred. No disruptive behavior was 

seen. 

Extent of Class Formality 

The degree of class formality was measured in two ways: the mode by which the teacher and students 
addressed each other and the way in which guided practice was conducted (whether the student needed to approach 
the teacher before obtaining assistance). 

Table 8. below, presents the most used forms of address and the number and percent of teachers and students, 
respect ivcl>. who used them. 

Table 8 

Forms of Address 



Note. N 14 sites. 

^Sums to 99.9 due to rounding. 

From T able 8. one can see that teachers addressed students by their first names in 13 (92.9%) sites and by last 
name with title (e.g., Mr.. Mrs.. Ms., etc.) in one (7.1%). Conversely, students addressed teachers by their first 
names in one (7.l^o) site, by their last names and a title in ten (71.4%), by their last name in one (7.1%), and no 
form of address was heard in two ( I4.3°o) sites. 



Direction 



Form of Address 



Teacher to 
Student 

n % 



Student to 
Teacher 



n 






First name 
Last name 
Last name with title 
Other or not heard 



13 92.9 

0 0.0 

1 7.1 

0 0.0 



1 7.1 

1 7.1 

10 71.4 

2 14.3 



14 




ERIC 



From Appendix C ( VII-3), one can learn that guided practice was conducted at the student's desk (or seat) in 
all 14 (100.0%) of the sites. Similarly, questions about the student's work were most often initiated by the teacher 
in all 14 ( 100.0® o) sites. 

Lesson Congruit> 

Lesson congruity. like class fonnality, was measured in two ways: whether class presentations were 

consistent with the lesson plan and whether any student was pulled out of a class activity then returned to it without 
benefit of a lesson recap. 

Table 0. below , shows the number and percent of teachers by lesson plan congruity. 

Table 9 

Lesson Plan Congruity 



Level of Congruity 



Teacher 



% 



Teacher followed the plan and referred to it during class 
Teacher followed the plan but did not refer to it during class 
Teacher had a lesson plan but did not follow it 



10 

0 



1 



71.4 

14.3 

14.3 



Note. N - 14 teachers. 



As can be seen in Table 9, all 14 ( 100.0® o) of the teachers had a lesson plan. Twelve (85.7®/o) followed it, ten 
(71 .4%) referring to it durini^ class. Two ( 14.3®b) did not appear to follow it. 

With regard tc pulling students out of a lesson then returning them to it without summarizing what occurred 
in their absence. Appendix C (VI 11-2) shows that this happened in one (7.1®/o) site. 
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Testing Occurrence and Procedures 



During four (28,6%) of the 14 observations, testing occurred, Table 10, below, summarizes the major 
findings regarding testing procedures within these four observations. 

Table 10 

Occurrence of Testing Variables 









Occurred? 










Testing Variables 




Yes 




No 


Unspecified/ 

Unknown 


Total 




n 


% 


n 


% 


n 


% 


n 


% 


Student Behavior 


















All students took test 


2 


50.0 


2 


50.0 


0 


0.0 


4 


100.0 


Non-test takers separated^ 


1 


50.0 


1 


50.0 


0 


0.0 


2 


100.0 


Non-test takers talking^ 


0 


0.0 


2 


100.0 


0 


0.0 


2 


100.0 


Test takers talking 


1 


25.0 


3 


75.0 


0 


0.0 


4 


100.0 


Books and papers put away 




75.0 


1 


25.0 


0 


0.0 


4 


100.0 


Teacher Behavior 


















Teacher provided oral instruc- 
tions prior to the test 


2 


50.0 


2 


50.0 


0 


0.0 


4 


100.0 


Teacher distributed the test 


4 


100.0 


0 


0.0 


0 


0.0 


4 


100.0 


Teacher collected the test 


4 


100.0 


0 


0.0 


0 


0.0 


4 


1 00.0 


Teacher corrected the test 


3 


75.0 


1 


25.0^ 


0 


0.0 


4 


100.0 


Teacher recorded the score 


2 


50.0 


1 


25.0^ 


1 


25.0 


4 


100.0 


Teacher gave inappropriate 
assistance 


2 


50.0 


2 


50.0 


0 


0.0 


4 


100.0 



Note. N ^ 4 classrooms. 

^The numbers and percents of these rows are based only upon the two testing instances when some members of 
the class were not among the test takers. 

^Done by an aide. 
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An examination of Table 10 indicates that not all of the expected testing procedures were observed in testing 
settings. In only half (2'. 50.0%) of the cases a teacher offered verbal instructions prior to the test and in half of the 
cases a teacher offered inappropriate assistance to a test taker . One (25.0%) test takers were talking; but in the cases 
where there were non-takers, none were observed talking, in only one (50.0%) case were test takers and non-takers 
physically separated. Further, in three (75.0%) cases, books and papers were put away. 

However, in all four (100.0%) of the sites, a teacher distributed and collected the tests, and the results were 
recorded by a teacher (3; 75.0%) or an aide ( 1 ; 25.0%). In three (75.0“/o) instances test correction was done by the 
teacher and in one (25.0'’o) case by an aide. 

Last, the content areas of the tests were: mathematics, language arts, and spelling (Appendix C, lX-1 1). 
Additional Comments 

The following is a summary of comments which either expanded upon what the evaluator observed or 
provided pertinent details which were not addressed by the observation instrument (Appendix C, X). 

• 1 hirteen minutes of class time was taken to watch Channel One (d; 64.3%). 

• Five minutes were used for passing between classes - students received no 
break in three-hour block (9; 64.3%). 

• Thirty minutes were used for relaxation time and fifteen minutes were used for 
walking'exercise these activities were part of the lesson plan ( 1 ; 7.1%). 

• Class was held in an inappropriate room; acoustics were bad and the 
temperature varied drastically (1; 7.1%). 



On the next page, the product evaluation results are presented. A summary of the process and product results 



can also be found starting on page 26. 



Product 



ABE data were analyzed with respect to the criteria for each objective of the grant. These analyses are 
presented below, 

Student Enroilment 

The grant specified enrollment goals for seven ABE student classifications. Table 1 1, below presents these 
classifications, their respective goals and enrollment figures, and whether the standards were attained. 



Table 1 1 

ABE Student by Classification and Standard 



Population 

Classification 


Minimum Percent 
Enroilment Standard 


Participants 

Enrolled 

n^ % 


Attainment 
of Standard 


Adults with limited 
English language skills 


10 


68 


6.2 


No 


Unemployed 


15 


873 


79.7 


Yes 


Rural 


2 


53 


4.8 


Yes 


Handicapped 


10 


3 


0.3 


No 


Minority 


75 


962 


87.8 


Yes 


Female heads of 
households/ADC 
recipients 


15 


390 


35.6 


Yes 


Homeless 


I 


0 


0.0 


No 



Note. N - 1 ,096 students. 

^Figures represent duplicated counts; total N in Note does not include the one student for whom no 
demographic information was submitted. 



By examining Table I 1, it can be seen that the program attained its enrollment objectives for four of the 
seven classifications (57. l^o). 
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Recruitment 



Prior to and for the first month of t!ie 1994/95 school year, a recruitment campaign was conducted for the 
ABE program. The campaign consisted of the distribution of bulletins containing general information about the 
program, e.g., class offerings and locations, and phone numbers to call for information. 

The major goals of the recruitment were to attract new students and to motivate previous students to return. 
The recruitment standard was that at least 10% of the student population be new to the program. According to 
enrollment data. 563 of 1 .096 (5 1 .4%) students were new. The standard was met . 

Dropout Prevention 

1'he grant specified that the ABE program was to attain a dropout rate at or below 40% from among the 
students who received at least 12 hours of instniclion. A dropout was defined as a student w'ho leaves the program 
for a reason other than the following: employment, passing the GED, completing his/lier ABE objectives, or death. 
In two prior years ( 1987-88 and 1988-89) this standard was attained. 

A review of year-end data indicated that 349 of the 828 (42.1%) students receiving 12 hours of instruction 
(see Table 12. below ) dropped out of the program. This represents a substantial decrease in the dropout rate from 
1993-94 (48.0%), however, the dropout prevention standard was not attained . 

Student Achievement 

The program served five student classifications; handicapped, ESL/bilingual (hereafter referred to as ESL), 
incarcerated, senior citizen, and regular (those not classifiable in the other four categories). The grant specified that: 

1) individual ABE objectives were to be assigned to every student receiving 12 hours or more of instruction: 

2) 75% of those students, w'ithin classification and across the program, were to attain mastery on at least 75% of 
their objectives; and 3) the Test of Adult Basic Education (TABE) will be used to report student achievement pre- 
and post-test scores with grade level gains. 

Data related to these specifications for this year (and a three-year review) are presented below. 
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Objective Assienment 



A review of the records demonstrated that 828 adult learners received at least 12 hours of instruction. Table 
12, below, is a presentation of students, by classification and total, who received 12 or more hours of instruction and 
the number and percent of them who were assigned objectives. Table E-1, in Appendix E, presents this data by 
teacher. 

Table 12 

ABE Students^ Objective Assignment by Classification 



Classification 


Students 

n 


Students Assigned 
Objectives 

n % 


Handicapped 


1 


1 


100.0 


ESL 


52 


52 


100.0 


Incarcerated 


117 


109 


93.0 


Senior citizen 


33 


33 


100.0 


Regular 


629 


603 


96.0 


Tota|t> 


828 


794 


93.9 



Note. N - 828 students. 

^Students who received at least 12 hours of instruction. 

^Toia\ is less than the sum of student in each classification; students may belong to 
more than one. 

As can be seen in Table 12, 794 of the 828 (95.9%) students who were provided 12 hours or more of 
instruction were assigned individual objectives. In only three of the five classifications, were 100.0% of the 
students assigned objectives. Further, from reviewing Table E-1 (Appendix E), one can see that at only 5 of the 16 
(31.2%) sites, 100% of the students who received 12 or more instructional hours were assigned objectives. This 
portion of the program objective was not attained. 
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Objective Attainment 



With regard to student performance, Table 13, below, presents the number and percent of students (with at 
least 12 hours instruction and assigned individual objectives), by classification and program total, who mastered at 
least 75% of their individual objectives. (Table E-2, Appendix E, presents this data by teacher.) 

Table 13 

ABE Students^ by Classification W'ho Attained the Standard^ 



Classification 


Students 

n 


Students Attaining 
Standard^ 

n % 


Program 

Standard^ 

Attained? 


Handicapped 




1 


1 


:oo.o 


Yes 


ESL 




52 


41 


78.8 


Yes 


Incarcerated 




1 17 


96 


82.1 


Yes 


Senior Citizen 




33 


24 


72.7 


No 


Regular 




629 


408 


64.9 


No 


Total*^ 


I 828 

— 


566 


68.4 


No 



Note. N ^ 828 students. 

^With at least 12 hours of instruction. 

^Mastery of at least 75%of hislier individual objectives. 

^75% of students will meet individual standard. 

^Totals are less than the sum of the students in each classification; students may belong to more than one. 
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A review of Table 13 reveals that, program-wide, the performance standard was not attained . A review also 
reveals that: 

• The performance standard was attained by ESL and incarcerated students; 

• However, performance standard was not attained by senior citizen, and regular 
ABE students; 

• Since only one handicapped student received at least 12 hours of instruction, 
meaningful interpretation of that result to a group cannot be made. 

Further, by examining Table E-2 (Appendix E), one can see that nine of the 16 (56.2%) teachers met the 
program standard (i.e., 75% or more of their students attained mastery of at least 75% of their objectives). 

As an additional analysis of this year’s student performance. Tables E-3 and E-4 (Appendix E) present 
respectively a bottom versus top half distribution of objective mastery attainment by classification and teacher. 

An examination of Table E-3 reveals that, program-wide, 87.0% of the ABE students attained at least 50% of 
their objectives (i.e., 13.0® b mastered less than 50% of their objectives). Similar success rates were evident within 
four of the five categories, ranging from 86.5% (among ESL) students to 97.0% (among senior citizen students) 
attaining at least 50% of the objectives.' Further, an examination of Table E-4 demonstrates that one of 14 (7.1%) 
teachers had 100.0% of their students mastering at least 50.0% of the objectives” and that another six of 14 (42.9%) 
showed between 90.0% to 99.9% of their students mastering 50% or more of the objectives. 

TABE Gains , The final objective involved student achievement on TABE. This year (1994-95) was the 
second year when both program completion and level movement were accomplished through gains in pre- to post- 
TABL scores (such a move required at least a one grade level unit gain). ' 

Because as of this writing, no standard for this program objective had been established, the extent of student 
achievement was documented. The program supervisor submitted to the Evaluation Department lists of students 
who had either completed the program or realized grade unit gains based on TABE scores. They are summarized in 
Table 14 below. 

" The success rate for the one handicapped student was 100.0% objectives mastered. 

” One laid-off teacher had only one student who was not transferred to another leacher; interpretation of the 
teacher's results should be done with caution. 
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Table 14 



ABE Program Movement 



TABE Score Gains 


Students^ 
N % 


Completed program 


57 6.9 


Increased at least one 


131 15.8 


grade unit level 




Total 


188 22.7 


Note. N ^ 828 students. 



^Of the 828 students who received at least 12 
instructional hours. 

From Table 14. it can be seen that 188 (22.7%) of the students who received at least 12 instructional hours 
realized at least one grade unit gain on TABE. 

When considering these results, the reader should keep in mind that while gains in TABE scores represent an 
important student achievement goal of the program, it is not the only one. As described in the previous sections, the 
program also realized success in attaining the objective content goals to which it directly teaches. 

Longitudinal . An overall three-year comparison of objective assignment and performance data was 
conducted. In each year, less than 100% of those students receiving 12 or more hours of instruction were assigned 
objectives. The numbers and percents of students for each year are given in Table 15 below’. 
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Table 15 



ABE Objective Assignment by Year 



Students^ Students 



Year 




Assigned 


Objectives 




N 


N 


% 


1992-93 


924 


906 


98.1 


1993-94 


843 


821 


97.4 


1994-95 


828 


794 


95.9 



Note. N ^ 2,595 students. 

^Who received at least 12 hours of instruction. 



A three-year review of the number and percent of students (who received both 12 hours of instruction and 
individual objectives), by classification and program total, who met the standard (mastering 75? o of their objectives) 
is presented in Table 16 below. 



Table 16 

ABE Students^ by Classification Who Met the Standard^ by Year 









Students Meeting Standard 






Classification 


1992-93 


1993-94 


1994-95 




n 


% 


n 


% 


n 


% 


Handicapped 


34 


49.3 


2 


28.6 


1 


100.0 


ESL 


50 


74.6 


60 


81.1 


41 


78.8 


Incarcerated 


84 


94.4 


113 


83.7 


96 


82.1 


Senior ciii/en 


50 


78.1 


25 


73.5 


24 


72.2 


Regular 


499 


77.2 


449 


74.0 


408 


64.9 


TotaF 


682 


73.8 


639 


75.8 


566 


68.4 







Note. N - 2,595 students. 

^With 12 hours instruction and assigned objectives. 

^Mastery of at least 75% of hisTier individual objectives. 

^Totals are less than the sum of students in each classification; students may belong to more than one. 
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An examination of Table 16 reveals the following points: 




• Program-wide the proportion of students attaining the standard approached the 
pr ogram criterion (75% of the students) in 1992-93, achieved it in 1993-94, 
but there was overall decline between 1993-94 and 1994-95. 

• ESL student performance fluctuated across the three years. 

• Performance levels of senior citizen and incarcerated students decreased over 
the three years. 

• There was an insufficient number of handicapped students in 1993-94 and 
1994-95 to make any meaningful longitudinal comparisons. 



In viewing these results, readers should bear in mind that the program provided services to largely voluntary, 
high-need students. It speaks well of the supervisor and staff to consistently maintain the program-wide success 
rates depicted above. 





Summary 



The 1994-95 school year was the 34th consecutive year the School District of the City of Saginaw has 
operated an Adult Basic Education (ABE) program. This program served a diverse population of adults (all of 
whom had a less than eighth grade education) using objectives specifically designed to address their educational 
needs. During this year, 1,097 adult learners received services by attending one or more of the 23 classes conducted 
at the four centers located throughout Saginaw. 

Both a process and a product evaluation w as conducted. The findings are presented in the subsections below. 

Process 

A process evaluation was conducted to determine the status of program operations during 1994-95 and 
consisted of on-site, classroom observations. The observation instrument focused on ten aspects of an ABE 
classroom: start of the class; time spent on each subject area (reading, mathematics, and MLRC) and total; modes 
of instruction; extent of individualized instruction; materials used; feedback; disruptive behavior; classroom 
fomiality; lesson congruiiv: and testing occurrence/procedures. 

The classroom observations yielded the following findings: 



• In most (if not all) classes, the teacher ... 

— Began on time; 

— Used a sign-in sheet; 

- Was in the room prior to class; and 

- Offered a preview. 

• In most (if not all) classes, reading, mathematics, and MLRC lessons were 
offered, but class time per topic varied. 

• Instructors used multiple methods of instruction (including individualized 
instruction) and checked for students' lesson understanding. Most offered 
lesson previews but lesson closure and teachers specifying objectives were not 
frequently seen. 

• Positive and negative feedback were effective and used appropriately. 
Disruptive behavior was not seen. 

• Of the 14 teachers, most teachers (12; 85.7%) followed lesson plans and 10 
(7 1 .4%) referred to them during class. In only one (7. 1%) site was a student’s 
lesson interrupted by a pullout. 
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• Testing was observed in four (28.6%) of the sites. Deviations from proper 
procedure were observed, they included test takers talking, not putting books 
and papers away, and teacher providing inappropriate assistance. 

In general, the ABE program operated as planned. 

Product 

A product evaluation was conducted to determine whether the program attained the objectives specified in its 
funding grant. 

The 1994-95 grant contained 11 objectives comprising 13 components. Seven of these 13 (53.8%) 
components were attained. This represents a slight decrease from the previous year when eight of 13 (61.5%) 
objective components were attained. 

With regard to student objective attainment, the program did not meet its standard; of those students 
who received 12 or more instructional hours, 68.4% attained mastery on over 75% of their objectives. This 
represents a program-wide decrease from last year (75.8%) when the standard was met. Among student 
classifications, the standard was met among ESL and incarcerated students; however, neither the senior citizen, nor 
the regular ABE students met the standard (there were not enough handicapped students to make a reasonable 
conclusion). 

In fuither analysis, it was found that the standard was met by nine of the 16 (56.2%) teachers and that 87.0% 
of the students who received at least 12 hours of instruction attained mastery on at least 50% of their individually 
assigned objectives. 

Also, 22.7% of the students demonstrated at least one grade unit growth between pre- and post-test TABE 
scores. (Again readers should be reminded to view these gains in TABE scores in light of the fact that the program 
was successful in student attainment of the objectives to which it directly teaches.) 

In viewing these results, readers should recall that the program has experienced nearly consistent 
success rates with a largely high need, voluntary student population. 

Figure 1. below, summarizes the ABE program's objective attainment for 1994-95. 
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Figure 1. Objective Mastery Summary 



Objective 


Standard 


SuDDortins Data 


Standard 

Achieved? 


ESL Instruction 


10% or more of population 
are ESL students 


6.2% ESL students 


No 


Services to the 
unemployed 


1 5% or more of population 
are unemployed students 


79.7% unemployed students 


Yes 


Services to the 
rural 


2 % or more of population 
are rural students 


4.8% rural students 


Yes 


Services to the 
incarcerated 


Full-time program for 
county jail inmates 


Full-time program provided 


Yes 


Services to the 
handicapped 


10% or more of population 
are handicapped students 


0.3% handicapped students 


No 


Services to minorities 


75% or more of population 
are minority students 


87.8% minority students 


Yes 


Services to women 
with special needs 


1 5% or more of population 
are special needs students 


35.6% female students 
with special needs 


Yes 


Recruitment 


10% or more of population 
are new students 


5 1 .4% new students 


Yes 


Academic services 


a. 100% with 12 or more 
hours are assigned 
objectives 


a. 95.9% with > 12 hours 
were assigned objectives 


No 




b. 75% will attain 75% 
of their objectives 


b. 68.4% attained 75% of 
their objectives 


No 




c. Test of Adult Basic 
Education (TABE) will 
be used to report student 
achievement pre- and 
post-test scores with 
grade level gains 


c. Standard to be developed; 
22.7% evidence grade 
level gains 


Yes 


Dropout prevention 


Less than 40% of student 
population will drop out 


42.1% dropped out 


No 


Services to the 
homeless 


1% or more of population 
are homeless students 


0.0% homeless students 


No 



In light of these findings and the findings of the process evaluation, recommendations intended to help 
improve the ABE program have been developed. They begin on the following page. 



Recommendations 



In light of the 1994-95 process and product findings and conversations with the program supervisor and staff, 
the following recommendations, grouped by category, are offered. 

Prior to offering these recommendations, it should be reiterated that the program is, overall, attaining most of 
its goals. These recommendations are presented with the aim of enhancing an already effective ;■ '^ram. 

It should be noted that the recommendations below are not meant to be exhaustive: the enhancements they 
suggest may be attainable through other means. The supervisor and staff may want to consider what other means 
are available and are encouraged to seek help from the Department of Evaluation, Testing, and Research. 

Process 

Overall, the program operated as planned. However, there were two major organizational differences 
between this and previous years. This was the first year when classes were shared among teachers. It was also the 
first year when students were not allowed a break in the three-hour class block (except for five minutes passing 
from one classroom to another). 

It is unknown what impact these changes may have had on students’ attitude toward the ABE program or 
their participation in it. 

• In light of the notable decrease in student performance, the supervisor and 
staff should assess student attitude and, if these changes have had a negative 
impact, make some determination about how to ameliorate this impact. 

Further, deviations between the supervisor's intent and program operations still exist in the areas of subject 
area coverage (time on topic) and testing. 

• The supervisor should continue to monitor lesson plans and conduct classroom 
observations to determine which teachers deviate the most from intended 
subject area coverage. 

• The supervisor should also determine if there is some specific unmet need 
which is impeding these teachers' ability to provide instruction in the desired 
mode and if there is some way the program can meet this need. 
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• The supervisor and staff should review testing procedures (what should be 
done and what may not be done) and identify the best ways for testing to be 
conducted properly in the future. Aides, since they are included in testing 
activities, should be included in these reviews. 



Product 



Not all of the program objective components were attained, however, seven (53.8%) were. The following 
recommendations address wavs toward attainment of more. 

Student Performance 

As mentioned above, this is the first year when classes were shared among teachers. Also there was a 
decrease in teaching staff during this year which (since there was no commensurate decrease in student enrollment) 
increased the student'teacher ratio. 



• The supervisor and staff may wish to consider what, if any, impact either of 
these events may have had as related to the decrease in student performance. 

• As pan of this review, the supervisor and staff should identify from among the 
successful sites what teaching strategies can be applied or modified in the less 
successful sites. 

• A standard for student achievement on TABE should be set. Given the 1994- 
95 results (22.7% of the students attained at least one grade level gain), a 
program-wide standard of 20% would seem appropriate. 



• The supervisor* and staff should review recruitment procedures for 
insufficiently represented student subgroups to determine if additional efforts 
are needed and, if so, how best to implement them. 

• One possible way to do this may be through continuing contacts with 
charitable and social agencies serving the community. 



Recruitment 
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Paperwork 



• The supervisor and staff should continue to review the instrument and the 
correct reporting processes for accuracy prior to their submission to the 
Evaluation Department. These reviews, at minimum, should verify the 
following: 

— Student demographic data; 

— Students have received 12 or more hours of instruction should have 
assigned objectives; and 

— Performance data is accurate and complete. 

• The supervisor should consider additional inservice opportunities on proper 
reporting form completion for those instructors who have experienced 
difficulties in this area. 
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APPENDIX A 



Table A-1 

ABE Students by Gender 



Students 



Gender 


n 


% 




Male 


577 


52.6 




Female 


519 


47.4 




Total 


1,096 


100.0 





Note. N = 1,096 students. 



Table A-2 






ABE Students by Racial Classification 




Students 


Racial Classification 


n 


% 


Indigenous American 


11 


1.0 


Hispanic 


162 


14.8 


White 


134 


12.2 


Black 


755 


68.9 


Oriental 


21 


1.9 


Not Specified 


13 


1.2 


Total 


1.096 


100.0 



Note. N - 1 ,096 students. 
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APPENDIX A 



Table A-3 

ABE Students by Age Group 



Students 



Age Group 


n 


% 


13-16^ 


1 18 


10.7 


17-20 


391 


35.7 


21-30 


269 


24.5 


3 1 -40 


177 


16.1 


41-50 


83 


7.6 


51-60 


25 


2.3 


61-70 


23 


2.1 


71 and older 


7 


0.7 


Not Specified 




0.3 


Total 


1,096 


100.0 



Note. N 1 .096 students. 

^Enrolled in pregnant teen program or court placement. 
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APPENDIX B 



ADULT BASIC EDUCATION CENTERS 



Center Name 
Redeemer Lutheran Church 
Ruben Daniels Lifelong Learning Center 
Saginaw County Jail 
Tri-Citv SER: Jobs For Progress 



Street Address 

3829 Lamson 
1 15 W. Genesee 
208 S. Harrison 
620 Thompson 
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APPENDIX C 




1994-95 ABE OBSERVATION SHEET 
(N=14) 



Date: 

Time Class Began: 



Evaluator: 



Teacher: 



Location: Ruben Daniels Lifelong (10; 71.4%) 

Learning Center* 

Other (cooperative (4; 28.6%) 

agreement) sites 



INSTRUCTIONS: Please circle or fill-in as appropriate. 



Class: ABE (1 1; 78.6%) ESL(I;7.1%) BILINGUAL (1; 7.1%) PREGNANT TEEN (1; 7. 1%) 

(Range) Number Enrolled: 9-23; Number Attending: 2-18: Percent Attending: 22.2-44.49o 



1. THE START OF THE CLASS 



1 . Did the class begin on time? 


YES 


(14; 100.0%) 


NO 


(0; 


0.0%) 


2. Was the teacher in the room at least 


YES 


(13; 92.9%) 


NO 


(1; 


..o 

o' 


five minutes prior to its start? 

3. Was a sign-in sheet used to take attendance? 


YES 


(14; 100.0%) 


NO 


(0; 


0.0%) 



4. Was the class given a preview of the day's 
activities and'or upcoming events,.. 



In oral form? 

In written form? 

In both forms? 

No preview given. 



I (7.1%) 

4 (28.6®^o) 

8 (57.1%) 

1 (7.1%)** 



* Program's home site 
**Sums to 99,9® 0 due to rounding. 
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APPENDIX C 



n. READING/LANGUAGE ARTS (Observed in 14 sessions; percents in this section based on those 14). 



1. Time (in minutes) spent on reading: M = 90.9 SD:=17.4’’‘ 

2. Which of the follow ing instructional materials were used? 



Textbooks and/or workbooks 

Handouts 

Journals 

Computer assisted instruction 
Card reader 
Audio tape 

3. Which of the following modes of instruction 

Modeling (examples given) 

Guided practice (monitoring) 

Checking for understanding 

Drill 

Lecture 

Problem solving 
Group discussion 
Review Tollow'-up 
Reading aloud (student) 

Reading aloud (teacher) 

Reading aloud (choral) 

Question and answer 
Chalkboard exercises 

4. Was the instruction individualized... 



YES 


(12; 85.7%) 


NO 


(2; 14.3%) 


YES 


(8; 57.1%) 


NO 


(6:42.9%) 


YES 


(4; 28.6%) 


NO 


(10: 71.4%) 


YES 


(2; 14.3%) 


NO 


(12: 85.7%) 


YES 


(1; 7.1%) 


NO 


(13:92.9%) 


YES 


(1:7.1%) 


NO 


(13:92.9%) 


were used? 


YES 


(3:21.4%) 


NO 


(1 1; 78.6%) 


YES 


(13:92.9%) 


NO 


(1:7.1%) 


YES 


(13: 92.9%) 


NO 


(1: 7.1%) 


YES 


(2: 14.3%) 


NO 


(12: 85.7%) 


YES 


(2: 14.3%) 


NO 


(12: 85.7%) 


YES 


(1: 7.1%) 


NO 


(13:92.9%) 


YES 


(5:35.7%) 


NO 


(9: 64.3%) 


YES 


(9:64.3%) 


NO 


(5: 35.7%) 


YES 


(7: 50.0%) 


NO 


(7: 50.0%) 


YES 


(7: 50.0%) 


NO 


(7: 50.0%) 


YES 


(0; 0.0%) 


NO< 


14: 100.0%) 


YES 


(2: 14.3%) 


NO 


(12:85.7%) 


YES 


(4; 28.6%) 


NO 


(10: 71.4%) 



On a one-on-one basis? 

On a small group basis? 

On both bases? 

No individualized instruction seen. 



(8:57.1%)='* 
(1; 7.1%) 
(3:21.4%) 

(2: 14.3%) 



* When classes not scheduled in a three hour block and or designed for a specific course content (e.g.. LSL) were 
excluded, the mean was 83.5 minutes (SD 1 1 . 1 ) 
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5. Which of the following were observed during reading instruction? 



A preview of the lesson 


YES 


(9; 64.3%) 


NO 


(5; 35.7%) 


A check for students' prior knowledge 


YES 


(9; 64.3%) 


NO 


(5; 35.7%) 


Teacher specified objective 


YES 


(8; 57.1%) 


NO 


(6; 42.9%) 


Closure on the lesson 


YES 


(2; l4.3»o) 


NO 


(12; 85.7‘’b) 


Comments on the readinu session: 











III. MATHEMATICS (Observed in 14 classrooms; percents in Section HI 2-5 are based on these 14). 



Time (in minutes) spent on reading: M = 48.7 


SD: = 


^ 13.2* 






Which of the following instructional materials were used? 








Textbooks and/or workbooks 


YES 


(10; 71.4%) 


NO 


(4; 28.6%) 


Handouts 


YES 


(7; 50.0%) 


NO 


(7; 50.0%) 


Notebooks 


YES 


(1; 7.1%) 


NO 


(13:92.9%) 


Computer assisted instruction 


YES 


(l;7.1%) 


NO 


(13; 92.9%) 


Flashcards 


YES 


(l;7.1%) 


NO 


(13; 92.9%) 


Which of the following modes of instruction w ere used? 








Modeling (examples given) 


YES 


(2; 14.3%) 


NO 


(12: 85.7%) 


Guided practice (monitoring) 


YES 


(11:78.6%) 


NO 


(3:21.4%) 


Checking for understanding 


YES 


(12; 85.7%) 


NO 


(2: 14.3%) 


Drill 


YES 


(1; 7.1%) 


NO 


(13:92.9%) 


Lecture 


YES 


(3:21.4%) 


NO 


(11:78.6%) 


Problem solving 


YES 


(3:21.4%) 


NO 


(11:78.6%) 


Group discussion 


YES 


(5: 35.7%) 


NO 


(9; 64.3%) 


Review/follow-up 


YES 


(6:42.9%) 


NO 


(8: 57.1%) 


Reading aloud (student) 


YES 


(1: 7.1%) 


NO 


(13:92.9%) 


Exercises on chalkboard 


YES 


(5; 35.7°o) 


NO 


(9:64.3°o) 


Kumon method** 


YES 


(1: 7.|4o) 


NO 


(13:92.9%) 



* When classes not scheduled in a three hour block and/or designed for a specific course content (e.g., ESL) were 
excluded, the mean was 46.1 minutes (SD - 12.3) 

**Kumon method is a structured sequential individualized program of study: see Appendix G for details. 
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4. Was the instruction individualized,,. 

On a one-on-one basis? 

On a small group basis? 

On both bases? 

No individualized instniction seen. 
Kumon method** 



(8; 57,1%)* 
(2; 14,3%) 
(I; 7,1%) 
(2; 14.3%) 
(I; 7,1%) 



5. Which of the following were observed during mathematics instruction? 

A preview of the lesson YES( 1 1 ; 78,6%) NO (2; 14.3%) 

A check for students' prior knowledge YES( 1 1: 78.6%) NO (2: 14.3%) 

Teacher specified objective YES (10; 71.4%) NO (3; 21,4%) 

Closure on the lesson YES (4; 28.6%) NO (9; 64.3%) 

6. Comments on the mathematics session: 



NA***(1;7,1%) 
NA (l;7.l%) 
NA (1:7.1%)* 
NA (l;7.1%) 



IV, 



MICHIGAN LIFE ROLE COMPETENCIES (MLRC) (Observed in 12 classrooms; percents in 

Section IV are based on these 12). 

1. Time (in minutes) spent on reading: M = 22.7 SD; - 14.4**** 

2. Which of the following instructional materials were used? 



Textbooks and or w orkbooks 


YES 


(11:91.7%) 


NO 


(1;8.3%) 


Wall chart 


YES 


(1; 8.3%) 


NO 


(11;9I.7%) 


Map 


YES 


(1:8.3%) 


NO 


(ll;91,7%) 


Handout 


YES 


( 1 : 8.3%) 


NO 


(11; 91.7%) 


Globe 


YES 


(1: 8.3%) 


NO 


(13; 91.7%) 



*Sums to 99 9® 0 due to rounding. 

** Kumon method is a .structured sequential individualized program of study; see Appendix G for details. 
***Not included in the Kumon instruction method. 

**** When classes not scheduled in a three hour block and or designed for a specific course content (e.g., ESI.) 
were excluded, the mean was 27.5 minutes (SD ^ 1 1 8). 
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3. Which of the following modes of instruction were used? 



Modeling (examples given) 


YES 


(0; 0.0%) 


NO(12; 100.0%) 


Guided practice (monitoring) 


YES 


(4; 33.3%) 


NO 


(8; 66.7%) 


Checking for understanding 


YES 


(9; 75.0%) 


NO 


(3; 25.0%) 


Drill 


YES 


(1; 8.3%) 


NO 


(II; 91.7%) 


Lecture 


YES 


(2; 16.7%) 


NO 


(10; 83.3%) 


Problem solving 


YES 


(1; 8.3%) 


NO 


(11:91.7%) 


Group discussion 


YES 


(8; 66.7%) 


NO 


(4:33.3%) 


Review/follow-up 


YES 


(6; 50.0%) 


NO 


(6: 50.0%) 


Reading aloud (student) 


YES 


(6; 50.0%) 


NO 


(6: 50.0%) 


Reading aloud (teacher) 


YES 


(6; 50.0%) 


NO 


(6; 50.0%) 


Reading aloud (choral) 


YES 


(1; 8.3%) 


NO 


(11:91.7%) 


Question and answer 


YES 


(1; 8.3%) 


NO 


(11:91.7%) 


Chalkboard exercises 


YES 


(0; 0.0%) 


NO (12; 100.0%) 


Was the instruction individualized... 










On a one-on-one basis? 


(2; 16.7%) 








On a small group basis? 


(I; 8.3%) 








On both bases? 


(1; 8.3%) 








No individualized instruction seen. 


(8:66.7%) 








Which of the following were observed durin 


g MLRC instruction? 






A preview of the lesson 


YES 


( 1 1 ; 9 1 .7%) 


NO 


(1; 8.3%) 


A check for students' prior know ledge 


YES 


(10; 83.3%) 


NO 


(2; 16.7%) 


Teacher specified objective 


YES 


(7; 58.3%) 


NO 


(5; 4 1.7%) 


Closure on the lesson 


YES 


(7; 58.3%) 


NO 


(5; 4 1.7%) 



6. Comments on the MLRC session; 
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V. FEEDBACK 

Sometime during the second half of class, take a ten minute block of time. Within it, 
observe the nature and amount of positive and negative feedback. (This would include, 
respectively, positive and negative comments in regard to class work or behavior.) 

FEEDBACK* 



Positive 



Negative 



1 . Frequency of feedback? 


M - 5.9; SD - 2.4 




!V1 = 


F1.5;SD-0.5 


2. Appropriate, generally? 


YhS(14: 100.0%) 


NO (0:0.0%) 


Yi:s 


(2: 14.3%) 


3. Effective, generally? 

4. Generally followed by 
statements of expected 
behavior? 


Yi-S( 14; 100.0%) 


NO (0;0,0%) 


YES 


(2; 14.3%) 



NO(0; 0.09o) 

N()((): 0.0%) 



Please comment: 



VI. DISRUPTIVE BEHAVIOR 

Please describe any instances of disruptive behavior in the class. Minor disruptions would 
include such behaviors as students talking out of turn sufficient to distract the lesson. 
Major disruptions would include behaviors which would threaten other students in the class 
or the teacher, or using the teacher’s authority. 



DISRUPTIONS 



Major 



Minor 



1 . Frecjuency M - 0.0: SD - 0.0 IVl - 0.0: SD - 0.0 

2. Generali) limited to a few students? N/A N/A 

3. Please specify the nature of the disruption(s) and the teacher's reaclion(s). Include details as 
necessary. 

N.'A 



’^Positive feedback was observed in all 14 (IUU.0%) sites: negative feedback was observed in two ( 14. 3*^0) sites. 



O 
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VII. CLASS FORMALITY 

1 . Please describe how the teacher and students addressed each other in class 

a. Most often, how did the teacher refer to the students? 

(Circle one) 

FIRST NAME (13; 92.9%) 

LAST NAME (0; 0.0%) 

LAST NAME WITH TITLE ( I ; 7.1%) 

BOTH FIRST NAME AND LAST NAME WITH TITLE (0; 0.0%) 
OTHER (0; 0.0%) 

b. Most often, how did the students refer to the teacher? 

FIRSTNAME (1:7.1%) 
l.AST NAME (1; 7.1%) 
l.AST NAME WITH TITLE (10:71 .4%) 

OTHER (0:0.0%) 

-(Please specify) Not heard (2: 14.3%) 

2. Please describe how guided practice was conducted. 

a. Most often, where was guided practice conducted? 

(Circle one) 

TEACHER'S DESK (0: 0.0?«) 

STUDENT'S DESK (14: 100.0%) 

b. Most often, who initiated questions about the student's work? 

TEACHER (14: 100.0%) 

STUDE*:NT (0:0.0%) 
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Vm. LESSON CONTIGUITY 



1 . Were the class presentations consistent with the lesson plan? (Check one) 



a. Teacher followed the plan and referred to it during class. 

b. Teacher followed the plan but did not refer to it during class. 

c. Teacher had a lesson plan but did not follow it. 

d. Teacher had no lesson plan. 



(10; 71.4%) 
(2; 14.3%) 
(2; 14.3%) 
( 0 ; 0 . 0 %) 



2. During any time in the class, was a student(s) pulled out from a group activity for individual in- 
struction then returned to the group without having the group activity recapped? 



IX. TESTING PROCEDURES 

1 . Did testing occur during the class time? 

YES (4; 28.6%) 

NO (10; 71.4%) 

(Note: Four test sessions were observed. The percents in IX. 2-1 1 [except 3 a-cj are based on those 
four tests.) 

2 . Were instructions given orally prior to the test being distributed? 

YES (2; 50.0%) 

NO (2; 50.0%) 



YES (1;7.1%) 
NO (13; 92.9%) 
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3. Did all of the students take the test? 

YRS (2:50.0%) 

NO (2:50.0%) 

(Note: Percents in VIM 3 a-c are based on the two instances where not all students took the test.) 

a. Were the students physically grouped or regrouped into test takers 
and non-test takers? 

YRS (I: 50.0%) 

NO (1; 50.0%) 

b. Did talking among the non-test takers occur during the test? 

YES (0:0.0%) 

NO (2: 100.0%) 

If Yes. how did the teacher react? N A 

c. Specify what those not talking the test were doing. 

- Written assignments (2) 

4. Were all of the books and papers put awa> before the test began? 

YES (3: 75.0%) 

NO (1; 25.0%) 

5. Was blank paper and/or the test instrument distributed by the teacher? 

YES (4; 100.0%) 

NO (0: 0.0%) 



If no, how were they distributed? 

6. Did talking among the test takers occur during the test? 

YES (1: 25.0%) 

NO (3: 75.0%) 

If yes. how did the teacher react? 

-Participated in the talking ( 1 ) 

7. Who corrected the tests? 

The teacher (3: 75.0°o) 

Aide (1:25.0%) 
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8, Were the lest papers or answer sheets collected? 



YES (4: 1 00.0° o) 
NO (0:0.0%) 



If yes. were they collected by.., 



The teacher? (4) 
A teacher's aide? (0) 



9. How were the grades recorded? 



Teacher retained to record after class (2: 50.0° o) 



Not seen 
By aide 



(1;25.0%) 

(1;25.0%) 



1 0. Did the teacher offer any inappropriate assistance to the lest takers? 



YES 

NO 



(2: 50.0%) 
(2; 50.0°o) 



If yes, please specif>. 

♦ Teacher read reading section aloud and reviewed it before the test. ( 1 ) 

♦ Teacher informed the evaluator that the student had been taking the same test 
as a practice test throughout the week and therefore did not need oral instructions. ( I ) 



1 1 , Specif> the type of lest (e g., spelling).* 

-Spelling (3) 

-Language arts (2) 

-Mathematics ( 1 ) 

*Two sessions distributed two tests. 

X. OTHER COMMENTS 

Please comment on anything salient vou observed occurring in this class which was not 
addressed by the above questions. 



• Thirteen minutes of class time was taken to watch Channel One . (9) 

• Five minutes were used for passing between classes - students received no book 
for three-hour block. (9) 

• Thirtv minutes were used for relaxation time and fifteen minutes used for 
walking exercise. These activities were part of the lesson plan. ( 1 ) 

• Class was held in an inappropriate room; acoustics were bad and the temperature 
varied drastically (1) 
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XL LESSON TIME 

I. I'otal class time* 

Scheduled; M I80.0;SD 21.0 

Actual: M 167.3; SD 24.7 

(Note; the mean difference between scheduled and actual instruction time was -12.7 minutes 
[SD - 8.6].) 



2. I'emporal order of subject areas 

(Note: by supervisor directive, reading, mathematics, and MLRC instruction were to occur in 
each class session, in that respective order.) 

a. Reading 



■ First 

- Second 

- I'hird 

- First and Fourth 

- Not seen 

b. Mathematics** 



- First 

- Second 

- Third 

- Not seen 

c. Ml.RC^ 

- First 

- Second 

- fhird 

- Fourth 

- Not seen 



(5, 35.7%) 
( 0 ; 0 . 0 %) 
(9; 64.3%) 
( 0 ; 0 . 0 %) 
( 0 ; 0 . 0 %) 



(3; 21.4%) 
(10; 71.4%) 
(I; 7.1%) 
( 0 ; 0 . 0 %) 



(6; 42.9%) 
(4; 28.6%) 
(I; 7.1%) 
(l;7.1%) 
(2; 14. 3*^/0) 



♦Scheduled class time varied due to constraints which were specific to the host building or (in the pregnant teen 
class) the nature of the instructional program. 

♦♦Sums to 99.9" o due to rounding. 
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V. PARENTING (RDLLC S-27, only) |Seen in one class] 

1 . Time (in minutes) spent on Parenting: 50 

2. Which of the following instructional materials were used? 



Textbooks and/or workbooks 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Flashcards 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Movie 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Videotape 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Computer assisted instruction 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Handouts 


YES 


(1; 100.0%) 


NO (0; 0.0%) 


Which of the following modes oi instruction were used? 






Guided practice (monitoring) 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Modeling 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Checking for understanding 


YES 


(0;0.0%) 


NO (1; 100.0%) 


Drill 


YES 


(1; 100.0%) 


NO (0;0.0%) 


Reading aloud (teacher) 


YES 


(0: 0.0%) 


NO (1; 100.0%) 


Reading aloud (choral) 


YES 


(0;0.0%) 


NO (1: 100.0%) 


Reading aloud (student) 


YES 


(1; 100.0%) 


NO (0;0.0%) 


Chalkboard exercises 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


LxCiiire 


YES 


(0:0.0%) 


NO (1: lOO.O^'o) 


Problem solving 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Group discussion 


YES 


(1; 100.0%) 


NO (0:0.0%) 


Review follow-up 


YES 


(0: 0.0%) 


NO (1; 100.0%) 


Question^answer 


YES 


(1; 100.0%) 


NO (0;0.0®o) 


Was the instruction individualized... 








On a one-on-one basis? 


(0; 0.0%) 






On a small group basis? 


(0; 0.0%) 






On both bases? 


(0; 0.0%) 






No individualized instruction seen. (1 


; 100.0%) 






Which of the follow ing were observed d iring 


Parenting 


instruction? 




A preview of the lesson 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


Closure on the lesson 


YES 


(0; 0.0%) 


NO (1; 100.0%) 


A check for students' prior knowledge 


YES 


(1: 100.0%) 


NO (0:0.0%) 


Teacher specified objective 


YES 


(0; 0.0%) 


NO (1: 100.0%) 



6. Comments on the Parenting session: 
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V. LANGUAGE EXPANSION TECHNIQUES (BILINGUAL/ESL CLASSES, only) 

(Seen In two classes) 

Sometime during the second hour of class, take a ten minute block of time. Within it, 
observe the teacher's efforts to increase English language use by the students (e.g., asking 
questions and probing for multiple word complex responses). 

1. What was the frequency of questions? M 22.5; SD 7.5 

2. What was the number of students who were asked a (2; 100.0%) 

question (percent of students in room)? 

3. Did the students, generall>, offer multiple word'complex responses? 

YES (2; 100.0%) 

NO (0; O.O^.o) 

4. Were the responses appropriate, generally? 

YES (2; 100.0%) 

NO (0; 0.0%) 

5. Were the responses followed by a teacher prompt for a longer/more complex response? 

YES (2: 100.0%) 

NO (0; 0 . 0 %) 
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Table E-1 

ABE Student^ Objective Assignment by Teacher 



readier 


Students 

n 


Students Assigned 
Objectives 
n % 


A 


26 


26 


100.0 


B 


67 


67 


100.0 


C 


35 


31 


88.6 


D 


42 


42 


100.0 


H 


73 


72 


98.6 


F 


88 


87 


98.9 


G 


59 


58 


98.3 


U 


71 


60 


84.5 


1 


59 


54 


91.5 


J 


85 


84 


98.8 


K 


79 


78 


98.7 


L 


26 


26 


100.0 


M 


25 


24 


96.0 


N 


10 


9 


90.0 


O 


82 


75 


91 5 


P 


1 


1 


100.0 


Total 


828 


794 


95.9 



Note. Not' teachers 16 and N of students 828. 
^Who received at least 12 hours instruction. 
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Table E-2 

ABE Student^ by Teacher Attaining the Standard^ 



Teacher 


Students 


Students Attaining 
Standard 


Program Standard 




n^ 


n 


®/o 


Attained?^ 


A 


26 


23 


88.4 


Yes 


B 


67 


67 


100.0 


Yes 


C 


35 


30 


85.7 


Yes 


D 


42 


35 


83.3 


Yes 


t: 


73 


37 


50.7 


No 


1 


88 


50 


56.8 


No 


Cj 


50 


12 


20.3 


No 


n 


71 


58 


81.6 


Yes 


I 


50 


35 


59.3 


No 


J 


85 


57 


67.1 


No 


K 


79 


36 


45.6 


No 


1. 


26 


18 


69.2 


No 


M 


25 


24 


96.0 


Yes 


N 


10 


8 


80.0 


Yes 


O 


82 


75 


91.5 


Yes 


P 


1 


1 


100.0 


Yes 


Total 


828 

1 


566 


68.4 


No 



Note. N of teachers ^ 16 and N of students 828. 

^Who received at least 12 hours of instruction. 

^Attaining mastery on at least 75® o of individual objectives. 
^'At least 75® 0 of students attaining mastery. 
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Table E-3 

Distribution of Objective^ Attainment Levels by ABE Students*^ by Classification 



Attainment Levels 



Classification 


Students*^ 


(0.0% - 


49.9%) 


(50.0% - 


100,0%) 




n 


n 


% 


n 


% 


Handicapped 


1 


0 


0.0 


1 


100.0 


f:SL 


52 


7 


13.5 


45 


86.5 


Incarcerated 


1 17 


1 1 


9.4 


106 


90.6 


Senior citizen 


33 


1 


3.0 


32 


97.0 


Regular 


629 


89 


14.2 


540 


85.8 


Total^ 


828 


108 


13.0 


720 


87.0 



Note. N 828 students. 

^Individually assigned objectives. 

^Who received at least 12 hours of instruction. 

^Total is less than the sum of students in each classification; students ma> belong to more than one. 
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Table E-4 

Distribution of Objective^ Attainment Levels by ABE Students^ by Teacher 



Teacher 




Students^ 


(0.0% 


Attainment Levels 
-49.9%) (50.0%- 


100.0%) 






n 


n 


% 


n 


% 


A 




26 




7.7 


24 


92.3 


n 




67 


0 


0.0 


67 


100.0 


c 




35 


4 


1 1.4 


31 


88.6 


D 




42 


3 


7.1 


39 


92.9 


h 




73 


7 


9.6 


66 


90.4 


F 




88 


13 


14.8 


75 


85.2 


G 




59 


24 


40.7 


35 


59.3 


H 




71 


1 1 


15.5 


60 


84.5 


1 




59 


8 


13.6 


51 


86.4 


J 




85 


5 


5.9 


80 


94.1 


K 




79 


16 


20.3 


63 


79.7 


L 




26 


5 


19.2 


21 


80.8 


M 




25 


1 


4.0 


24 


96.0 


N 




10 




20.0 


8 


80.0 


O 




82 


7 


8.5 


75 


91.5 


P 




1 


0 


0.0 


1 


100.0 


Total 




828 


108 


13.0 


720 


87.0 



Note. N of teachers 16 and N of students ^ 828. 

^Individually assigned objectives. 

^Who received at least 1 2 hours of instruction. 
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S( linol Di'sUii I I'l llw ( it\' i>l S(ii;in<n\ 

Sa|*ina\v Area [/iteracy 
Adult Basic Kducalion i^ro^rain 



Ailult lUisic lulin (Uion Studcnis. 
E.S.L. Students. 

liilin^iuil Students and ISitron.s 
Annual Recognition ('enunons 




KuIk'ii Daniels I.ilclt'iig I.eainiiig ('enter 
Nine ueloek 
Thursday mornini; 

May IK, l‘>‘).^ 



B2 




Program 






Welcome Louise R. Kring 

Supervisor, Adult Basic Edncation/E.S.L./Rilingual 

Breakfast 

Remarks Y.T Gray 

Director, Ruben Daniels Lifelong Learning Center 

Remarks Donald R. Scoll 

Assistant Superintendent of Adult and Continuing Education 

Congratulations Minerva Rosales 

Secretary, Saginaw Board of Education 

A.B.E./Bilingual 1994-95 Graduate Essie Patillo 

Ruben Daniels High School 

Perfect Attendance Awards Marva Gordon 

Student Advisor 

Program Progress Within Level Certificates Ann Tamosky 

Adult Basic Education Teacher 

Program Level Movement Certificates Ruth Anderson 

Adult Basic Education Teacher 

Program Completion Certificates Marvin Smith 

Adult Basic Education Teacher 

Welcome George W. Adams 

Supervisor, Ruben Daniels Lifelong Learning Center High School 



A special thanks to Nancy Taylor, pianist, 
Marva Gordon, Ann Tarnosky, and 
Sue Larson who helped coordinate 
the Breakfast. 
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APPENDIX F 



APPENDIX G 



In the narrative portion of the 1992 English Literacy Grant, the Kumon Method is described as: 



. . . A highly structured, sequential, and individualized program . . . based on mastery of the 
subject matter, repetition, and drill. Students are placed at the appropriate level through the 
use of a diagnostic test. Total mastery of the material must occur before the student moves 
on to the next level. Success is experienced by the learner through immediate feedback which 
in turn build upon the students self-confidence and self-esteem. Instruction using the Kumon 
Method consists of 30 minutes per day in each subject area and is designed to complement the 
regular reading and mathematics instruction. The program has been very successful where it 
has been used. The Kumon Method differs from the traditional instructional approach in that 
new concepts are introduced through the exercises/problems themselves, that is, the facts are 
taught first and then the concept or theory . . . The Kumon Method has been used successfully 
in Japan, Australia, and the United States including use by business and industry. The program 
has been featured in Time , Newsweek , and the Wall Street Journal . 



The Detroit News (Cannon, 1992) reported that around the world, '‘about 17 million students in 17 
countries are learning [by the] Kumon [Method]” (p. B2): in the United States, about 80,000 students in 1,160 
settings and in Michigan over 500 students in 24 settings are learning this way. 



Reference: Cannon, A. ( 1992, December 2). Lessons make math easy as 1-2-3. Detroit News , dp. B1-B2. 
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In the narrative portion of the 1992 English Literacy Grant, the Kumon Method is described as: 

... A highly structured, sequential, and individualized program . . . based on mastery' of the 
subject matter, repetition, and drill. Students are placed at the appropriate level through the 
use of a diagnostic test. Total mastery of the material must occur before the student moves 
on to the next level. Success is experienced by the learner through immediate feedback which 
in turn build upon the students self-confidence and self-esteem. Instruction using the Kumon 
Method consists of 30 minutes per day in each subject area and is designed to complement the 
regular reading and mathematics instruction. The program has been very successful where it 
has been used. The Kumon Method differs from the traditional instructional approach in that 
new concepts are introduced through the exercises/problems themselves, that is, the facts are 
taught first and then the concept or theory . . . The Kumon Method has been used successfully 
in Japan, Australia, and the United States including use by business and industry. The program 
has been featured in Time, Newsweek, and the Wa!) Street Journal . 



The Detroit News (Cannon. 1992) reported that around the world, "about 17 million Mudents in 17 
countries are learning [b\ the] Kumon [Method]” (p. B2); in the United States, about 80.000 students in 1,160 
settings and in Michigan over 500 students in 24 settings are learning this way. 






Reference: Cannon. A. ( I December 2). Lessons make math easv as 1-2-3. Detroit News , pp. B1-B2. 
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